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(54) Abstract Title 

Method and system for preventing unauthorized access to a computer program 

(57) A system and method for preventing a program from being run under a debugger utility program. The 
method is part of a routine which is stored along with a software program on a hard drive (16) of a computer 
system (10). The computer system (10) has a processor (12) for running both the software program (26) and 
the routine (100) and is capable of operating in a debug mode. The routine (100) prevents unauthorized access 
to the software program (26), such as when the processor (12) is running in the debug mode. When the 
processor (12) is running the software program (26), the program (26) can initiate execution of the routine 
(100). Once initiated, the routine (100) checks a certain register of the processor to determine if it is operating 
in the debug mode and if so, stops the processor (121) from continuing to run the software program. 
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METHOD AND SYSTEM FOR PREVENTING 
UNAUTHORIZED ACCESS TO A COMPUTER PROGRAM 

The present disclosure relates generally to computers and computer 
programs, and, more specifically, to a system and method for preventing programs 
from being run under a debugger utility program. 

A computer program that is stored inside a computer often contains many 
protectable intellectual properties. Certain ones of these properties are readily 
protectable through copyright and/or patent laws. However, others of these 
properties are protectable as trade secrets, and therefore require the utmost level of 
security to prevent unauthorized use or access. 

Preventing unauthorized use or access of a particular program becomes 
difficult once the program is attained by a user who is not subject to software licenses 
or other forms of protection. For example, diagnostic programs are often installed on 
a computer by the computer's manufacturer and contain many trade secrets of the 
manufacturer. Topically, only the executable (.exe) portion of the program is 
installed, thereby keeping the source code from the user. Further, the .exe portion of 
the program is often encrypted. For example, a utility program PKLITE from 
PKWARE, Inc. of Brown Deer, WI, compresses the .exe portion of the program, 
thereby encrypting it in the process. However, this does not prevent a user from 
running the program through a debugger utility program. The debugger utility 
program makes the computer's processor operate in a suspended execution mode 
which causes the processor to stop execution or jump to another routine at certain, 
predefined intervals. For the sake of example, the processor may be a PENTIUM 
processor, as produced by Intel, Corp. of Santa Clara, CA, and examples of suspended 
execution modes include a debug and a single-step operating mode, all of which are 
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described in greater detail in the INTEL ARCHITECTURE SOFTWARE DEVELOPER'S 
MANUAL Vols. 1-3, 1997, provided by Intel Corporation, which is hereby incorporated 
by reference. By using the debugger program, the user can wrongfully access the 
program, thereby accessing the trade secrets stored therein. 

Therefore, what is needed is a system and method that would prevent 
unauthorized access of a program, even through a debugger utility program. 



In response thereto, provided is a system and method for preventing a 
program from being run under a debugger utility program. In one embodiment, a 
routine and a software program are stored on a hard drive of a computer system.. 
The computer system has a processor for running both the software program and the 
routine and is capable of operating in a suspended execution mode. The routme 
prevents unauthorized access to the software program, such as when the processor - 
running in the suspended execution mode under a debugger utility program. When 
the processor is running the software program, the program can initiate execution of 
the routine. Once initiated, the routine checks a certain predetermined memory 
location to determine if it is operating in the suspended execution mode and if so, 
stops the processor from continuing to run the software program. 

In one embodiment, the memory location is an interrupt register of the 
processor, which indicates whether any breakpoints, which are commonly used in 
debug operating modes, are being used. The routine checks the interrupt register to 
determineifitpointstoanyotherprogramorroutine. If so, then the processor is 
Ukely running in debug mode and the routine stops the processor from continuing to 
run the original program. In another embodiment, the memory location is a flag 
register of the processor, which indicates whether other operating modes of the 
processor. In this embodiment, the routine checks the flag register to determine if it 
indicates a single-step mode of operation for the processor. If so. the routine stops 
the processor from continuing to run the program. 
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An example of the present invention will be described in accordance with the 
accompanying drawings, in which: 

Fig. 1 is a block diagram of a computer, and, 

Fig. 2 is a flow chart of a routine to be run by the computer of Fig. I. 

Referring to Fig. l, the reference numeral 10 designates a computer having 
several components, including at least one processor 12, RAM 14, a hard disk drive 
16, and a floppy disk drive 18. Each component is capable of communication with 
the processor 12. as graphically represented by a general bus 20. In the present 
example, the processor 12 is running DOS operating system code as provided by 
Microsoft Corp. of Redmond, WA. It is understood, however, that the computer 10 
and its illustrated components are merely representative of many different types of 
computers and components and that DOS is merely representative of many different 
types of operating systems, including Windows and Windows 95, also from Microsoft 
Corp. 

The processor 12 includes a plurality of registers, including an INTERRUPT 
register 22 and a FLAG register 24. The names of the registers 22. 24 relate to the 
PENTIUM and PENTIUM II processors, but are only meant to be illustrative of 
similar registers on practically all models and/or brands of processors. The registers 
22, 24 are also described in the Intel Architecture Software Developer's 
Manual, which has already been incorporated by reference and which further 
describes several different processor operating modes, including a normal mode, a 
debug mode, and a single-step mode. 

Stored on the hard drive 16 is a program executable Cexe) file 26. The 
program 26 is currently compressed and encrypted using a conventional utility such 
as PKLITE. described in greater detail above. Since the program 26 is encrypted, a 
user can not simply read the hard disk 16 to access and decompile the program. 
Conventionally, however, the user would be able to load the program 26 into RAM 14 
and run the program with the processor 12 using a debug utility program (not 
shown). By so doing, the user could learn each line of code in the program 26 and 
decompile the program, thereby attaining unauthorized access to the program. 
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Referring to Fig. 2, a routine 100, which is also stored on the hard disk 16, 
prevents the user from running the program 26 using the debug utility program. 
The program 26 launches the routine 100 during initial operation of the program. 
Therefore, for the sake of example, the routine 100 is an initialize routine, it being 
understood, however, that the routine 100 may be run at any time the program 26 is 
being executed. 

At step 102, the routine 100 checks the registers 22. 24. Using the Intel 
PENTIUM processor example discussed above, specifically INTERRUPT register 22 
is a Debug Register 7 and the FLAG register 24 is an EFLAG Register. At step 104, 
the routine 100 determines whether the trap flag (TF) of the EFLAG Register 24 is 
set. If TF is set. indicating single-step mode, the routine 100 halts execution of the 
program 26 at step 106. If TF is clear, execution proceeds to step 108, where the 
routine 100 determines where the breakpoint flag (INT 3) of the INTERRUPT 
Register 22 points. INT3 may point to a routine such as a breakpoint exception 
handler routine, which is often used by a debug program, or it may contain a return 
instruction TRET", which means that no other program or routine is called. If INT 3 
points to any instruction other than ERET, execution proceeds to step 106 described 
above. Otherwise, execution proceeds to step 110 where the routine 100 returns 
control to the program 26, which may now proceed normally. By checking the 
registers 22, 24, the routine 100 knows whether or not the processor 12 is operating 
in a debug mode, thereby preventing the program 26 from being run under a 
debugger utility program. 

Although illustrative embodiments have been shown and described, a latitude 
of modification, change and substitution is intended in the foregoing disclosure, and 
in certain instances, some features will be employed without a corresponding use of 
other features. For example, the routine 100 may be called repeatedly by the 
program 26. thereby further ensuring that the program is not being run by a 
debugger. Furthermore, the program 26 and routine 100 may be stored at different 
locations, additional or alternative registers, flags, or memory devices may be 
checked and additional error handling routines may be added to the illustrative 
embodiment without altering its scope. Accordingly, it is appropriate that the 
appended claims be construed broadly and in a manner consistent with the scope of 
the invention. 
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Claims 

' • A computer comprising: 

at least one processor for running a software program, the processor 
capable of operating in a suspended execution mode and having a first memory location 
that indicates whether the processor is cu^ently operating in the suspended execution 
mode; 

a storage device accessible by the processor; and 
a routine located in the storage device; 

wherein, when the processor is running the software program, the 
program is capable of initiating the routine; and 

wherein, once initiated, the routine checks the first memory location to 
determine if the processor is in the suspended execution mode and if so, stops the 
processor from continuing to run the software program. 

2 - computer of claim 1, wherein the first memory location is an 
interrupt register of the processor. 

3 - ^ computer of claim 1, wherein the first memory location is a flag 
register of the processor. 

4 The com P uter of claim 1, wherein the processor further includes a second 

memory location, the first memory location being an interrupt register and the second 
memory location being a flag register, and wherein either of the two registers may 
indicate whether the processor is currently operating in the suspended execution mode. 

5- The computer of any one of the preceding claims, wherein the suspended 

execution mode is a debug mode. 

6 71,6 com P uter of any one of the preceding claims, wherein the suspended 

execution mode is a single-step mode. 
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7 The computer of any one of .he preceding cU: ,s wherein, if .he routine 

determines that *. processor is no, in the suspended execution mode, the routine r^rns 
execution to the software program. 

8 . The computer of any one of the preceding claims, wherein the storage 

device is a hard disk. 

♦ ~f ,nv nne of claims 1 to 7, wherein the storage device is a 

9 The computer of any one oi ciaim* i w #, 

floppy disk. 

r r\*\m* 1 to 7 wherein the storage device is 

10 The computer of any one of claims i 10 /, wuci 

random access memory. 

n A method for preventing a user from running a program on a processor 

operating in a suspended execution mode, the method comprising the steps of: 
checking a first predetermined memory location; 
determining if the first memory location calls another routine; and 
if so, stopping the processor from continuing to run the program. 



I 

j 12. 



execution 



The method of claim 11 further comprising: 
checking a second predetermined memory location; 
determining if the second memory location indicates a suspended 
mode of operation for the processor, and 

if so, stopping the processor from continuing to run the program. 



13 . The method of claim 11 or 1 2, wherein the first memory location ,s an 
interrupt register of the processor. 

14 The method of ciaim 12, wherein the f.rs. memory .oca.ion is an interrupt 
register of the processor and the second memory location is a nag register of me 

processor. 
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15- The method of any one of claims 1 1 to 14, wherein the suspended 
execution mode of operation is a single-step mode, 

16- The method of claim 12 or any one of claims 13 to 15 when dependent 
on claim 12, wherein the suspended execution mode of operation is a debug mode. 

1 7 - A device for preventing a user from running a program on a processor 
operating in debug mode, the device comprising: 

means for checking a first predetermined memory location; 

means for determining if the first memory location indicates that the 
processor is operating in a suspended execution mode; and 

means responsive to determining that the first memory location indicates 
the suspended execution mode for stopping the processor from continuing to run the 
program. 

18. The device of claim 17 further comprising: 

means for checking a second predetermined memory location; 

means for determining if the second memory location points to another 

routine; and 

means responsive to determining that the second memory location points 
to another routine for stopping the processor from continuing to run the program. 

19. The device of claim 17 or 18, wherein the first memory location is a flag 
register of the processor. 

2°- The device of claim 1 8, wherein the first memory location is a flag 

register of the processor and the second memory location is an interrupt register of the 
processor. 

21- The device of any one of claims 17 to 21, wherein the suspended 

execution mode of operation is one of either a single-step mode or a debug mode. 
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22 A method of preventing unauthorized access to a computer program 

substantially as described with respect to any one of the accompanying drawings. 

23. A computer system substantially as described with respect to any one of 

the accompanying drawings. 
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